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(54) METHOD AND APPARATUS FOR TRANSCODING, AND MEDIUM 



(57) In a video TS packet separator, a video TS 
packet VTSP is extracted from a TS (transport stream). 
In a PES packet analyzer through a TS packet genera- 
tor, the video TS packet is decoded, re-encodes at a pre- 
determined bit rate, TS-packetized and supplied to a 



switch input terminal. The switch input terminal is also 
supplied with non-video TS packets UVTSP from a TS 
packet buffer. A controller is provided to control the TS 
packet generator and switch based on timing informa- 
tion and PCR from a TS packet timing manager. Thus, 
codes in the TS can be converted. 
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Description 

Technical Field 

[0001] The present invention relates to a transcoding s 
apparatus, method and medium, and more particularly 
to a transcoding apparatus, method and medium, for 
converting codes used in a transport stream having mul- 
tiplexed therein a video stream, audio stream and other 
data stream. 10 

Background Art 

[0002] In the satellite digital television broadcasting 
and the ground-wave digital television broadcasting is 
which is going to start soon, a transport stream (will be 
referred to simply as TS" hereinafter) conforming to the 
MPEG (Moving Pictures coding Experts Group) 2 sys- 
tems (ISO/IEC 13818-1) (will be referred to as "MPEG- 
2" hereinafter), is used as the broadcast wave. TS as 20 
the broadcast wave has multiplexed therein a video 
stream, audio stream and other data stream. 
[0003] When TS as the digital television broadcast 
wave is recorded into a recording medium, a bit rate 
changer as shown in FIG. 1 is used to reduce the code 25 
bit rate for a to-be-recorded TS if the data recording rate 
into the recording medium is lower than at a bit rate at 
which the TS is to be recorded. Note that since the bit 
rate changer functions to convert the code bit rate, it is 
a kind of transcoder for converting codes of an input 30 
stream. 

[0004] A TS demultiplexer 1 included in the bit rate 
changer shown in FIG. 1 separates an input TS via an 
input terminal IN into a video stream VS and audio 
stream AS and supplies them to an M PEG video decod- 35 
er 2 and MPEG audio decoder 4, respectively. 
[0005] The MPEG video decoder 2 decodes the sup- 
plied video stream VS to provide a video signal and sup- 
plies the video signal to an MPEG video encoder 3. The 
MPEG video encoder 3 will encode the supplied video *o 
signal to a video stream having a predetermined bit rate 
by the MPEG method, and supply the encoded video 
stream to a TS multiplexer 6. On the other hand, the 
MPEG audio decoder 4 decodes the supplied audio 
stream AS supplied to provide an audio signal and sup- 
plies the audio signal to an MPEG audio encoder 5. The 
MPEG audio encoder 5 will encode the supplied audio 
signal to an audio stream having a predetermined bi rate 
by the MPEG method, and supply the coded audio 
stream to the TS multiplexer 6. The TS multiplexer 6 will so 
multiplex the video stream supplied from the MPEG vid- 
eo encoder 3 and the audio stream supplied from the 
MPEG audio encoder 5 to provide a TS' having a re- 
duced bit rate. The TS* is delivered at an output terminal 
OUT. 55 
[0006] However, the conventional bit rate changer 
shown in FIG. 1 is disadvantageous in that when an input 
TS contains any elementary streams not conforming to 
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MPEG-2, the TS, once separated into elementary 
streams, cannot be re-multiplexed. For example, a pri- 
vate stream such as a data stream used in the digital 
television broadcasting is not conforming to MPEG-2, 
and each of service providers uniquely sets necessary 
buffer size and bit rate for multiplexing. No multiplexing 
is possible when the TS multiplexer 6 does not under- 
stand the buffer model for a stream to be multiplexed. 
Therefore, it is difficultto multiplex a private stream such 
as data stream for example except when the buffer mod- 
el of the stream is already known. 
[0007] Also, the conventional bit rate changer shown 
in FIG. 1 has a problem that it can change the bit rate 
of a transport stream TS having multiplexed therein one 
video stream VS and one audio stream AS, each con- 
forming to MPEG-2 but cannot change the bit rate of a 
TS having multiplexed therein one video stream VS and 
a plurality of audio streams AS. 

Disclosure of the Invention 

[0008] Accordingly, the present invention has an ob- 
ject to overcome the above-mentioned drawbacks of the 
prior art by enabling to separate an input TS containing 
any elementary streams not conforming to MPEG-2 into 
elementary streams and re-multiplex the elementary 
streams. 

[0009] The present invention has another object to 
permit to change the bit rate of a TS having multiplexed 
therein a plurality of elementary streams besides video 
streams. 

[0010] The above object can be attained by providing 
a transcoder for generating, from a first multiplexed 
stream, a second multiplexed stream, including accord- 
ing to the present invention: 

means for separating a first elementary stream from 
the first multiplexed stream supplied; 
means for converting the first elementary stream 
separated by the separating means by a predeter- 
mined method to a signal; 

means for packetizing the signal converted by the 
converting means to generate a first packet; 
means for storing timing information indicating a 
time at which a packet, containing a second ele- 
mentary stream forming the first multiplexed 
stream, appears in the multiplexed stream; and 
means for multiplexing, based on the timing infor- 
mation stored in the storing means, the first packet 
generated by the packetizing means and a second 
packet containing the second elementary stream to 
generate the second multiplexed stream. 

[0011] In the above transcoder according to the 
present invention, the converting means includes: 

means for decoding the first elementary stream 
separated by the separating means to generate an 



2 



EP1 111 796 A1 



original signal corresponding to the first elementary 
stream; and 

means for encoding the original signaJ generated 
by the decoding means at a predetermined bit rate. 

[0012] Also in the above transcoder, the converting 
means converts, by a predetermined method, codes 
forming the first elementary stream separated by the 
separating means. 

[001 3] Also in the above transcoder, the multiplexing 
means multiplexes, based on the timing information 
stored in the storing means, the second packet to the 
second multiplexed stream at a time corresponding to 
the time at which the second packet appears in the first 
multiplexed stream. 

[0014] Also the above object can be attained by pro- 
viding a transcoding method for generating, from a first 
multiplexed stream, a second multiplexed stream, in- 
cluding, according to the present invention, steps of: 

separating a first elementary stream from the first 
multiplexed stream supplied; 
converting the first elementary stream separated at 
the separating step by a predetermined method to 
a signal; 

packetizing the signal converted at the converting 
step to generate a first packet; 
storing timing information indicating a time at which 
a packet, containing a second elementary stream 
forming the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing information stored 
at the storing step, the first packet generated at the 
packetizing step and a second packet containing 
the second elementary stream to generate the sec- 
ond multiplexed stream. 

[0015] In the above transcoding method according to 
the present invention, the converting step includes steps 
of: 

decoding the first elementary stream separated at 
the separating step to generate an original signal 
corresponding to the first elementary stream; and 
encoding the original signal generated at the decod- 
ing step at a predetermined bit rate. 

[0016] Also in the above transcoding method, at the 
converting step, codes forming the first elementary 
stream separated at the separating step are converted 
by a predetermined method. 

[0017] Also in the above transcoding method, at the 
multiplexing step, the second packet is multiplexed to 
the second multiplexed stream at a time corresponding 
to the time at which the second packet appears in the 
first multiplexed stream based on the timing information 
stored at the storing step. 

[001 8] Also the above object can be attained by pro- 



viding a medium having recorded therein a transcoding 
program to generate, from a first multiplexed stream, a 
second multiplexed stream and which is to be executed 
by a computer, the program including, according to the 
5 present invention, steps of: 

separating a first elementary stream from the first 
multiplexed stream supplied; 
converting the first elementary stream separated at 
10 the separating step by a predetermined method to 
a signal; 

packetizing the signal converted at the converting 
step to generate a first packet; 
storing timing information indicating a time at which 
*5 a packet, containing a second elementary stream 
forming the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing information stored 
at the storing step, the first packet generated at the 
20 packetizing step and a second packet containing 
the second elementary stream to generate the sec- 
ond multiplexed stream. 

[0019] In the above medium according to the present 
25 invention, the converting step in the program includes 
steps of: 

decoding the first elementary stream separated at 
the separating step to generate an original signal 
30 corresponding to the first elementary stream; and 
encoding the original signal generated at the decod- 
ing step at a predetermined bit rate. 

[0020] Also in the above medium, at the converting 
35 step in the program, codes forming the first elementary 
stream separated at the separating step are converted 
by a predetermined method. 

[0021] Also in the above medium, at the multiplexing 
step in the program, the second packet is multiplexed 

^o to the second multiplexed stream at a time correspond- 
ing to the time at which the second packet appears in 
the first multiplexed stream based on the timing infor- 
mation stored at the storing step. 
[0022] These objects and other objects, features and 

43 advantages of the present invention will become more 
apparent from the following detailed description of the 
preferred embodiments of the present invention when 
taken in conjunction with the accompanying drawings. 

so Brief Description of the Drawings 

[0023] FIG. 1 is a block diagram of a conventional bit 
rate changer, showing an example of its construction. 
[0024] FIG. 2 is a block diagram of an embodiment of 
55 the transcoder according to the present invention. 
[0025] FIG. 3 is a block diagram of a code converter 
included in the transcoder in FIG. 2. 
[0026] FIG. 4 is a block diagram of a TS recorder us- 
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ing the transcoder in FIG. 2, showing an example of its 
construction. 

[0027] FIG. 5 explains the operation of the TS record- 
er in FIG. 4. 

[0028] FIG. 6 is a flow chart of operations effected in s 
switching control by a controller included in the trans- 
coder in FIG. 2. 

[0029] FIG. 7 is a block diagram of another embodi- 
ment of the transcoder according to the present inven- 
tion. 10 
[0030] FIG. 8A shows a personal computer incorpo- 
rating a recording medium having stored therein a trans- 
coding program. 

[0031] FIG. 8B explains the recording medium used 
to install the transcoding program into the personal com- is 
puter and enable the execution of the program. 
[0032] FIG. 8C explains a system used to install the 
transcoding program into the personal computer and 
enable the execution of the program. 
[0033] FIG. 9 is a block diagram of the personal com- 20 
puter, showing its internal construction. 

Best Mode for Carrying Out the Invention 

[0034] Referring now to FIG. 2, there is illustrated in 25 
the form of a block diagram an embodiment of the trans- 
coder according to the present invention. This transcod- 
er is to generate, from a first transport stream TS sup- 
plied as an input, a second transport stream TS*. The 
first transport stream TS is a one having multiplexed 30 
therein a video signal transport stream packet as a first 
elementary stream (will be referred to as Video TS 
packet VTSP" hereinafter) and non-video TS packets 
UVTSP including audio stream and other data stream. 
[0035] As shown in FIG. 2, the transcoder includes a 35 
video TS packet separator 1 0 to separate the video TS 
packet VTSP from the first transport stream TS supplied 
from an input terminal IN, a code converter 12 to con- 
vert, by a predetermined method, codes forming the vid- 
eo TS packet VTSP separated by the video TS packet *o 
separator 10, a TS packet generator 15 to generate a 
code-converted video TS packet VTSP* by packetizing 
the signal whose codes have been converted by the 
code converter 1 2, a TS timing manager 1 8 to store tim- 
ing information indicating a time at which the packet in- 45 
eluding the non-video TS packets UVTSP forming the 
first transport stream TS appears in the first transport 
stream TS, and a switch 16 to generate, and deliver at 
an output terminal OUT, the second transport stream TS' 
by multiplexing the video TS packet VTSP* generated so 
by the TS packet generator 1 5 and non-video TS packet 
UVTSP based on the timing information stored in theTS 
packet toning manager 18. The switch 16 functions as 
a multiplexer under the control of a controller 1 9 which 
will further be described later. 55 
[0036] The transcoder further includes a PES packet 
analyzer 11 provided between the video TS packet sep- 
arator 10 and code converter 12, the controller 19 pro- 
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vided between the TS packet timing manager 18 and 
switch 1 6, and a TS packet buffer 1 7. 
[0037] The video TS packet separator 10 extracts a 
video TS packet VTSP from the first transport stream 
TS supplied from the input terminal IN, and provides it 
to the PES packet analyzer 11 . Also, the video TS pack- 
et separator 1 0 extracts, from the first transport stream 
TS, the non-video TS packet UVTSP and provides it to 
the TS packet buffer 17. Further, the video TS packet 
separator 1 0 supplies the TS packet timing manager 1 8 
with timing information indicating a time at which the 
non-video TS packet UVTSP has been supplied as an 
input (information indicating a time at which the non-vid- 
eo TS packet appears in the first transport stream TS). 
[0038] The PES packet analyzer 1 1 uses the pay load 
of the video TS packet VTSP supplied from the video 
TS packet separator 1 0 to form a PES (packetized ele- 
mentary stream) and provides the coder converter 12 
with a encoded video signal being the pay load of the 
PES packet (will be referred to as "encoded video sig- 
nal" hereinafter). Also the PES packet analyzer 11 pro- 
vides the code converter 12 with a PTS (presentation 
time stamp) of the encoded video signal. Note here that 
the PTS is a parameter described in the header of the 
PES packet and indicates a time on the time base when 
the encoded video signal is to be reproduced. 
[0039] The code converter 1 2 converts, by the prede- 
termined method, the encoded video signal generated 
by the PES packet analyzer 1 1 from the video TS packet 
VTSP separated by the video TS packet separator 10. 
For example, when the transcoder is used as a bit rate 
converter shown in FIG. 1, the code converter 12 de- 
codes the encoded video signal, then re-encodes it at a 
predetermined bit rate (compression rate) and supplies 
it to the TS packet generator 15. Also, the transcoder 
may convent codes concerning copyright protection in- 
formation, for example, appended to the encoded video 
signal. 

[0040] First, bit rate conversion will be described be- 
low. In this case, the code converter 12 includes an 
MPEG video decoder 13 and MPEG video encoder 14 
as shown in FIG. 3. The MPEG video decoder 13 de- 
codes the encoded video signal supplied from the PES 
packet analyzer 1 1 , and provides the decoded video sig- 
nal to the MPEG video encoder 14. The MPEG video 
decoder 13 will also provide the MPEG video encoder 
14 with a PTS (presentation time stamp) corresponding 
to the video signal. The MPEG video encoder 14 re-en- 
codes, at a predetermined bit rate (compression rate), 
the video signal supplied from the MPEG video decoder 
13, and provides the TS packet generator 15 with the 
re-encoded video signal along with a PTS correspond- 
ing to the re-encoded video signal. Under the control of 
the controller 1 9, the TS packet generator 1 5 packetizes 
the encoded video signal supplied from the MPEG video 
encoder 14 to generate a video TS packet VTSP, and 
delivers it at an input terminal a of the switch 1 6. 
[0041 ] The switch 1 6 is controlled by the controller 1 9 
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to turn the output thereof to either the input terminal a 
or b thereof. The switch 16 will provide, via the output 
terminal OUT, either the video TS packet VTSP sup- 
plied to the input terminal a thereof from the TS packet 
generator 15 or the second packet stream TS* generat- 
ed by time-division multiplexing the non-video TS pack- 
ets UVTSP, supplied at the input terminal b thereof from 
the TS packet buffer 17. 

[0042] The TS packet buffer 1 7 stores non-video TS 
packets UVTSP supplied from the video TS packet sep- 
arator 10 and delivers them one after another at the in- 
put terminal b of the switch 16. 
[0043] The TS packet timing manager 1 8 manages 
timing information supplied from the video TS packet 
separator 10 and corresponding to the non-video TS 
packet UVTSP, stored in the TS packet buffer 17 (infor- 
mation indicating a time at which the TS packet UVTSP 
appears in the TS) and a PCR (program dock reference) 
indicating a time on the time base of the TS, and sup- 
plies them to the controller 19. 
[0044] The controller 1 9 controls the TS packet gen- 
erator 15 and switch 16 based on the timing information 
and PCR supplied from the TS packet timing manager 
18. 

[0045] The transcoder constructed to convert a bit 
rate as in the above is used in a transport stream (TS) 
recorder shown in FIG. 4. TheTS recorder records into 
a recording medium which will further be described later 
the second transport stream TS' generated by multiplex- 
ing the video TS packet VTSP' whose bit rate has been 
reduced by the code converter 1 2 of the transcoder, and 
non-video TS packet UVTSP. 

[0046] The TS recorded shown in FIG. 4 includes a 
transcoder as shown in FIG. 1 and a recording system 
including a bit stream purser 20 to recording medium 28. 
[0047] The bit stream purser 20 reads a PCR from TS 
packets supplied one after another from the switch 16 
and provides them to a PLL (phase locked loop) block 
21 and other to an Arrival_time stamp append block 23. 
The PLL block 21 locks a 27-MHz clock of the recording 
system to the PCR supplied from the bit stream purser 
20. The recording system also includes a time stamp 
generator 22 which generates a time stamp based on a 
count of 27-MHz clocks. 

[0048] When providing a TS packet supplied from the 
bit stream purser 20 to a smoothing buffer 24 also in- 
cluded in the recording system, the AmvaLtime stamp 
append block 23 appends to the TS packet a time stamp 
indicating a time at which a first byte of the TS packet is 
to be provided to the smoothing buffer 24. The smooth- 
ing buffer 24 stores the TS packet having the time stamp 
appended thereto, and provides it in units of a predeter- 
mined data amount appropriately to an error correction 
block 25 also included in the recording system. The error 
correction block 25 appends an error correction code to 
the TS packet supplied from the smoothing buffer 24 
and provides it to a modulator 26 also included in the 
recording system. The modulator 26 modulates the TS 



packet supplied from the error correction block 25 by a 
predetermined method, and provides it to a recorder 27 
also included in the recording system. The recorder 27 
records the modulated TS packet supplied from the 

5 modulator 27 to the recording medium 28. 

[0049] The transcoder used in the TS recorder func- 
tions as will be described below with reference to FIG. 
5. Note that actually, TS packets shown in FIG. 5D are 
delayed relative toTS packets shown in FIGS. 5A to 5C 

10 for time lengths of the operations of the PES packet an- 
alyzer 11 to TS packet generator 15. The non-video TS 
packets UVTSP are buffered in the TS packet buffer 1 7 
and provided at an appropriate time (as shown in FIG. 
5E) to synchronize these TS packets at each time indi- 

15 cated with a broken line in FIG. 5. 

[0050] When a TS having time-division multiplexed 
therein video TS packets VTSP (indicated with "V" in 
FIG. 5) shown in FIG. 5A and non-video TS packets 
UVTSP, is supplied from the video TS packet separator 

20 10 to the video TS packet separator 10, the latter will 
extract the video TS packets VTSP from the TS as 
shown in FIG. 5B, and provide them to the PES packet 
analyzer 11 . The video TS packet separator 1 0 will also 
extract the non-video TS packets UVTSP from the TS 

25 as shown in FIG. 5C, and provide them to the TS packet 
buffer 17. At the same time, the video TS packet sepa- 
rator 10 will provide the TS packet timing manager 18 
with information of a time at which the non-video TS 
packet UVTSP has been supplied. 

30 [0051 ] The PES packet analyzer 1 1 uses the pay load 
of the video TS packet VTSP supplied from the video 
TS packet separator 10 to provide a PES packet, and 
provides an encoded video signal being the pay load to 
the MPEG video decoder 13 in the code converter 12. 

35 The M PEG video decoder 1 3 decodes the encoded vid- 
eo signal supplied from the PES packet analyzer 1 1 , and 
provides the decoded video signal to the MPEG video 
encoder 14. 

[0052] The MPEG video encoder 14 re-encodes the 
40 video signal supplied from the M PEG video decoder 1 3 
at a predetermined bit rate (half of the bit rate of the TS 
packets shown in FIG. 5B when the video signal is the 
TS packets shown in FIG. 5D), and provides it, along 
with PTS to which the encoded video signal corre- 
^5 sponds, to the TS packet generator 15. Under the con- 
trol of the controller 19, the TS packet generator 15 
packetizes the encoded video signal from the MPEG 
video encoder 14 as shown in FIG. 5D, and provides it 
to the input terminal a of the switch 16. 
so [0053] On the other hand, the TS packet buffer 17 
supplies the non-video TS packets to the input terminal 
b of the switch 1 6 with a delay of a predetermined time 
as shown in FIG. 5E. 

[0054] The controller 1 9 controls the switch 1 6 to turn 
55 the output thereof to its input terminal a or b (as will fur- 
ther be described later with reference to the flow chart 
of FIG. 6). 

[0055] Thus, the video TS packets VTSP' and non- 
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video TS packets UVTSP are time-division multiplexed 
as shown in FIG. 5F are provided from the switch 1 6 to 
the bit stream purser 20 located downstream of the 
switch 16. 

[0056] The TS packets not continuous to each other 
as shown in FIG. 5F will be rearranged to be close to 
each other by the downstream smoothing buffer 24 in 
the recording system shown in FIG. 4 and then recorded 
in the recording medium 28. 

[0057] Next, the switching by the controller 1 9 will be 
described herebelow with reference to the flow chart in 
FIG. 6. First at step S1 , the controller 19 judges, based 
on the timing information and PCR supplied from the TS 
packet timing manager 18, whether the present time 
(elapsed from a time when the video TS packet separa- 
tor 10 was supplied with TS) is a time to provide non- 
video TS packets UVTSP on the time base of the TS. If 
it determines that now is not any time to provide the non- 
video TS packet UVTSP, it goes to step S2. 
[0058] At step S2, the controller 19 judges whether 
the TS packet generator 15 has been supplied with an 
encoded video signal to be TS-packetized from the 
M PEG encoder 1 4. If it determi nes that the encoded vid- 
eo signal to be TS-packetized is not supplied, it goes to 
step S3. 

[0059] At step S3, the TS packet generator 15 will be 
controlled by the controller 1 9 to packetize the encoded 
video signal from the MPEG video encoder 14 and pro- 
vide it to the input terminal a of the switch 1 6. The switch 
1 6 will be controlled by the controller 1 9 to turn an output 
thereof to the input terminal a and provide the video TS 
packet VTSP' supplied from the TS packet generator 1 5 
to the downstream bit stream purser 20 shown in FIG. 4. 
[0060] At step S5, the controller 1 9 judges whether all 
TS packets have been provided to the stage down- 
stream of the switch 16. If it determines that all the TS 
packets have not yet been provided, it goes back to step 
SI. 

[0061] If it is determined at step S1 that the present 
time is a time to provide the non-video TS packet UVT- 
SP, the controller 19 will go to step S4. At step S4, the 
switch 16 is controlled by the controller 19 to turn the 
output thereof to the input terminal b and provide the 
non-video TS packet UVTSP supplied from the TS pack- 
et buffer 17 to the bit stream purser 20 located down- 
stream of the switch 1 6. 

[0062] Thereafter, the controller 1 9 will go back to step 
S1 until it determines at step S5 that all the TS packets 
have been provided, and the operations at steps S1 and 
subsequent steps are repeated. When the controller 19 
determines that all the TS packets have been provided, 
the switching control will be ended. 
[0063] As in the above, the transcoder functioning to 
convert a bit rate can convert only the bit rate of video 
streams contained in a TS to generate a newTS wheth- 
er or not non-video elementary streams, contained in 
the TS are conforming to MPEG-2. 
[0064] Also the transcoder can convert the bit rate of 



video streams contained in a TS irrespectively of the 
number of non-video elementary streams contained in 
the TS to generate a new TS. 

[0065] The TS recorder can convert only the bit rate 
5 of video streams contained in a TS to generate and 
record a new TS whether or not non-video elementary 
streams contained in the TS are conforming to M PEG-2. 
[0066] Also the TS recorder can convert the bit rate 
of video streams contained in a TS irrespectively of the 
10 number of non-video elementary streams to generate 
and record a newTS. 

[0067] Note that the present invention is applicable to 
decoding of a video bit stream forming an input multi- 
plexed stream to generate an original signal, and re-en- 

15 coding of the original signal to convert the bit rate of the 
video bit stream forming the input multiplexed stream as 
well as to converting of codes appended to the video bit 
stream by a predetermined method, re-appending the 
converted code to the video bit stream and providing 

20 them . 

[0068] For example, the present invention is applica- 
ble to conversion by a predetermined method of a code 
concerning a copyright protection information appended 
to a video bit stream f orming an input multiplexed stream 

25 as shown in FIG. 7. The transcoder in FIG. 7 is different 
from that shown in FIG. 2 in that a copyright protection 
information converter 30 is used instead of the code 
converter 12 in FIG. 12, the output of the PES packet 
analyzer 1 1 is analyzed by an analyzer 31 and codecon- 

30 version in the copyright protection information converter 
30 is controlled according to the result of analysis from 
the analyzer 31 . 

[0069] The analyzer 31 analyzes the output of the 
PES packet analyzer 11 to detect copyright protection 
35 information such as copy control information (CCI), wa- 
ter mark signal, duplication generation information lim- 
iting the number of duplications, etc. embedded in an 
input video signal. The copyright protection inf ormation 
converter 30 updates, based on the result of analysis 
40 from the analyzer 31 , codes concerning the copyright 
protection information by a predetermined method and 
provides an updated video stream. 
[0070] For example, when the analyzer 31 detects du- 
plication generation information, the copyright protec- 
ts tion information converter 30 will count up the duplica- 
tion generation information by one, if the generation lim- 
itation is within an allowable range, append the count to 
the video transport packet VTSP correspondingly to the 
PTS, and send the packet to the TS packet generator 
so 15. 

[0071] On the other hand, when the generation limi- 
tation is beyond the allowable range, the copyright pro- 
tection information converter 30 wfll not provide the vid- 
eo TS packet VTSP to the TS packet generator 1 5. 
55 [0072] Thus, the transcoder shown in FIG. 7 can pro- 
vide a management to protect the copyright of the video 
transport stream. 

[0073] The transcoder shown in FIG. 7 may be com- 
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bined with the recording system including the bit stream 
purser 20 thru the recording medium 28 shown in FIG. 
4 to construct a TS recorder which will record TS includ- 
ing a video stream whose copyright is protected. Note 
that the TS recorder cannot record any TS depending s 
upon the type of the copyright protection information, for 
example, when the generation limitation is beyond the 
allowable range. 

[0074] Note that the present invention is applicable to 
conversion of the bit rate of a video stream included in 10 
a program stream or to conversion of a code appended 
to a video bit stream by a predetermined method. 
[0075] Also the present invention is applicable to con* 
version of the bit rate of an audio stream in an TS or 
conversion of an audio stream in a TS by a predeter- is 
mined method, and then multiplexing the audio stream 
with other elementary stream to generate a new TS. 
[0076] Further the present invention is applicable to 
conversion of the bit rate of a plurality of elementary 
streams such as both a video stream and audio stream 20 
or conversion of a plurality of elementary streams by a 
predetermined method, and then multiplexing them with 
other elementary stream to generate a new TS. 
[0077] The aforementioned series of processes can 
be executed by a hardware and also by a software. For 25 
execution of the series of processes by a software, a 
program forming the software is installed in a computer 
built in aTS recorded as a dedicated hardware, or a gen- 
eral-purpose personal computer capable of performing 
a variety of functions with a variety of programs cone- 30 
sponding to the programs installed therein. 
[0078] The medium according to the present inven- 
tion having recorded therein a program intended for ex- 
ecution of the above series of processes and which is 
to be installed in a general-purpose personal computer 35 
which can execute the program, will be described her- 
ebelow with reference to FIGS. 8A to 8C. 
[0079] The program can be provided to the user as 
being previously installed in a hard disc 302 or semicon- 
ductor memory 303, as a recording medium, incorporat- 
ed in a personal computer 301 , as shown in FIG. 8A. 
[0080] Alternatively, the program can be provided to 
the user as a package software as being provisionally 
or permanently stored in a recording medium such as a 
floppy disc 311, CD-ROM (compact disc-read-only « 
memory) 312, MO (magneto-optical) disc 313, DVD 
(digital versatile disc) 314, magnetic disc 315 or semi- 
conductor memory 316, as shown in FIG. 8B. 
[0081 ] Further, as shown in FIG. 8C, the program can 
be transferred by radio to the personal computer 301 so 
from a download site 321 via a satellite 322 or by cable 
or radio to the personal computer 301 from the down- 
load site 321 via a network 331 such as local area net- 
work (LAN) or Internet, and stored in the hard disc 302 
or the like incorporated in the personal computer 301 . 55 
[0082] The term "medium" referred to herein means 
a broad concept including all these media. 
[0083] The personal computer 301 incorporates a 
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CPU (central processing unit) 342 as shown in FIG. 9 
for example. The CPU 342 has an input/output interface 
345 connected thereto via a bus 341 . When supplied 
with a user's command via the input/output interface 345 
from an input unit 347 including a keyboard, mouse, etc., 
the CPU 342 responds to the command to load into a 
RAM (random access memory) 344, and execute, a pro- 
gram stored in an ROM (read-only memory) 343 corre- 
sponding to the semiconductor memory 303 shown in 
FIG. 8A, a program transferred from the satellite 322 or 
network 331 , received by the communication unit 348 
and installed in the hard disc 302, or a program read out 
from the floppy disc 311, CD-ROM 312, MO disc 313, 
DVD 31 4 or magnetic disc 31 5 loaded in a drive 349 and 
installed in the hard disc 302. Further, the CPU 342 pro- 
vides a result of a process executed thereby to a display 
unit 346 made of a LCD (liquid crystal display) or the like 
as necessary via the input/output interface 345 for ex- 
ample. 

[0084] Note that in this specification, steps of describ- 
ing the program provided to the user as stored in the 
medium include processes effected in a time series in 
the described order as well as processes effected in par- 
allel or individually. 

[0085] Note that the term "system" referred to herein 
means an entire assembly of a plurality of units. 

Industrial Applicability 

[0086] As having been described in the foregoing, ac- 
cording to the present invention, a first elementary 
stream is code-converted to generate a first packet Al- 
so, timing information indicating a time at which a sec- 
ond packet forming a second elementary stream ap- 
pears in a multiplexed stream is stored. The generated 
first packet and second packet are multiplexed based 
on the timing information, so the code of only the first 
elementary stream can be converted to generate a new 
second multiplexed stream whether or not the second 
elementary stream is conforming to MPEG-2. Also, it is 
possible to convert the codes of a TS having multiplexed 
therein a plurality of elementary streams in addition to 
video streams. 



Claims 

1 . A transcoder for generating, from a first multiplexed 
stream, a second multiplexed stream, comprising: 

means for separating a first elementary stream 
from the first multiplexed stream supplied; 
means for converting the first elementary 
stream separated by the separating means by 
a predetermined method to a signal; 
means for packetizing the signal converted by 
the converting means to generate a first packet; 
means for storing timing inf ormation indicating 
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a time at which a packet, containing a second 
elementary stream forming the first multiplexed 
stream, appears in the multiplexed stream; and 
means for multiplexing, based on the timing in- 
formation stored in the storing means, the first 
packet generated by the packetizing means 
and a second packet containing the second el- 
ementary stream to generate the second mul- 
tiplexed stream. 

2. The apparatus as set forth in Claim 1 , wherein the 
converting means includes means for decoding the 
f irst elementary stream separated by the separating 
means to generate an original signal corresponding 
to the first elementary stream, and means for en- 
coding the original signal generated by the decod- 
ing means at a predetermined bit rate. 

3. The apparatus as set forth in Claim 1 , wherein the 
converting means converts, by a predetermined 
method, codes forming the first elementary stream 
separated by the separating means. 

4. The apparatus as set forth in Claim 1 , wherein the 
multiplexing means multiplexes, based on the tim- 
ing inf onmation stored in the storing means, the sec- 
ond packet to the second multiplexed stream at a 
time corresponding to the time at which the second 
packet appears in the first multiplexed stream. 

5. The apparatus as set forth in Claim 1 , wherein the 
first elementary stream is a video stream. 

6. A transcoding method for generating, from a first 
multiplexed stream, a second multiplexed stream, 
comprising the steps of: 

separating a first elementary stream from the 
first multiplexed stream supplied; 
converting the first elementary stream separat- 
ed at the separating step by a predetermined 
method to a signal; 

packetizing the signal converted at the convert- 
ing step to generate a first packet; 
storing timing information indicating a time at 
which a packet, containing a second elementa- 
ry stream forming the first multiplexed stream, 
appears in the multiplexed stream; and 
multiplexing, based on the timing information 
stored at the storing step, the first packet gen- 
erated at the packetizing step and a second 
packet containing the second elementary 
stream to generate the second multiplexed 
stream. 

7. The method as set forth in Claim 6, wherein the con- 
verting step comprises the steps of: 
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decoding the first elementary stream separated 
at the separating step to generate an original 
signal corresponding to the first elementary 
stream; and 

encoding the original signal generated at the 
decoding step at a predetennined bit rate. 

8. The method as set forth in Claim 6, wherein at the 
converting step, codes forming the first elementary 
stream separated at the separating step are con- 
verted by a predetermined method. 

9. The method as set forth in Claim 6, wherein at the 
multiplexing step, the second packet is multiplexed, 
based on the timing information stored at the storing 
step, to the second multiplexed stream at a time cor- 
responding to the time at which the second packet 
appears in the first multiplexed stream. 

10. The method as set forth in Claim 6, wherein the first 
elementary stream is a video stream. 

11. A medium having recorded therein a transcoding 
program to generate, from a first multiplexed 
stream, a second multiplexed stream and which is 
to be executed by a computer, the program com- 
prising the steps of: 

separating a first elementary stream from the 
first multiplexed stream supplied; 
converting the first elementary stream separat- 
ed at the separating step by a predetermined 
method to a signal; 

packetizing the signal converted at the convert- 
ing step to generate a first packet; 
storing timing information indicating a time at 
which a packet, containing a second elementa- 
ry stream forming the first multiplexed stream, 
appears in the multiplexed stream; and 
multiplexing, based on the timing information 
stored at the storing step, the first packet gen- 
erated at the packetizing step and a second 
packet containing the second elementary 
stream to generate the second multiplexed 
stream. 

12. The medium as set forth in Claim 11, wherein the 
converting step in the program comprises the steps 
of: 

decoding the first elementary stream separated 
at the separating step to generate an original 
signal corresponding to the first elementary 
stream; and 

encoding the original signal generated at the 
decoding step at a predetermined bit rate. 

1 3. The medium as set forth in Claim 1 1 , wherein at the 
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converting step in the program, codes forming the 
first elementary stream separated at the separating 
step are converted by a predetermined method. 

1 4. The medium as set forth in Claim 1 1 , wherein at the 5 
multiplexing step in the program, the second packet 

is multiplexed to the second multiplexed stream at 
a time corresponding to the time at which the sec- 
ond packet appears in the first multiplexed stream 
based on the timing information stored at the storing io 
step. 

15. The medium as set forth in Claim 11, wherein the 
first elementary stream is a video stream. 
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